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PART II 

DESCRIPTION OF PROJECT 
OBJECTIVES, ACTIVITIES, AND EVALUATION 
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I . STATEMENT OF MAJOR PROJECT OBJECTIVE 

The pr'mary objective of project EDUCATE was to (I) reduce 
the □ccurrenca of student behaviors which interfere with attention, 
and (2) elicit and maintain student attending behavior* 

The inseryice training program, EOUCOURSE ONE, Is designed to 
train teachers of EMR classes in the systematic appUcatfon of 
teaching techniques which will ellmfnata student behaviors which 
Interfere with attention and which wilt maintain attending behavior* 
EDUCOURSE ONE centers upon a well-defined and doeumanted set of 
specif le skills and procedures for Inservlee education. The skMls 
are Interrelated and comprised of four separate Instructional 
sequences, each consisting of three steps* (I) Instruction, during 
which the teacher reads a prepared handbook lesson and views 
Instructional/model videotapes; (2) microteach I ng, In which the teacher 
pfmparBs and practices the skills In a controlled situation and evaluati 
his performance through videotape playback; and (3) reteachlng, during 
which he further practices and reinforces the use of the prescrfbad 
skills through practice and evaluation* The rationale for such a 
procedure focuses upon specific rather than general teaching Skills, 
short lessons with few students, direct practice and experlance, and 
Immediate Peinforcement from videotaped replays. 



EDUCOURSE ONE is a completely self-contained, f i eld-tested^ 
and evaluated package for inservlce trafning of special education 
cl assroom teachers . 

2. DESCRIPTION OF ACTtVITIES TO ACCOHPLISH OBJECTIVE 

RESEARCH AND DATA GATHERING 

Preliminary research and data gathering toward identification 
and definition of the content emphasis of EDUCOURSE ONE depended 
upon a review of research relevant to the learning behavior of EMR 
children, infornrtal interviews with e^cceptional child educators, and 
analysis of videotaped sessions in special education classrooms. 
The primary purpose of these activities was to Isolate, through con- 
siderations of fundamental learning principles and general learning 
characterlst ICS of mentally retarded childrenp pdsslble areas of 
content emphaifs for the inservlce training program^ Infofmation 
obtained In these preliminary efforts was used as the basis for Instruments 
to determine learning behaviors specific to EMR children in the five- 
county area which this project serves^ and then to identify instructional 
skills critical to successful learning for these children* 

LEARNING PROBLEMS INVENTORY 

The first such Instrument consisted of an inventory of learning 
problems, to which exceptional child educators In the five-county area 
responded. The Inventory, which was adapted from Hewett's '*0evelopmenta1 
Sequence of EducationHl Goals,'' a framework describing the essential 



behaviors and competencies children must possess to learn successfully 
in school, lists educational problems generally attrfbuted to excep- 
tional children. Teachers ware asked to assess these as learning 
problems actually representative of the particular students whom 
they teach, and to Indicate the student behaviors occurring In their 
classrooms which Interfered with effective instruction. 

The learning problems most frequently indfcated as occurring In 
their classrooms by the twenty exceptional child educators who res- 
ponded to this instrument were, in descending order of prevalence, as 
fol lows • 



Preya lance 
'Rank I nq 


1 tern 
No. 


1 


\k 


2 


11 


3 


6 


k 


12 


5 (a) 


1 


(b) 


3 


(c) 


8 


(d) 


9 


(e) 


15 


6 


20 



Statement of P rob 1 en 



Children are disruptive In group. 

Children respond to tasks for only Umfted periods 
of time. 

Children do not retain and use Instruction. 
Children do not follow directions. 
ChMdren do not pay attention to learning tasks. 
Children engage In repetitive behaviors vihlch 

interfere with learning. 
Children maintain a constrfcted level of 

performance* 
Children eKhlbit a narrow range of learning 
interests. 

Children do not finish learninq tasks. 
There is a discrepancy between chndran's capa- 
cities and functioning levels in Intellectual 
and academic skills 

Once the results of the Learning Problems Inventory were tabulated, 
eKceptlonal child educ^itors from Charlotte, DeSotO, Gladas, Hardee, and 
Hendry counties participated in a workshop to discuss the rmpllcatlons 
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of these results in terms of improving education for exceptfonal 
children. During this InteraGtion, the f nitructional problems 
indicated as most serious were those of managing disruptive 
behavior and Initiating and sustaining attention and response to 
learning tasks. This information was GOnsistent with the results 
of the Learning Problem Inventory, and teacher analysis and 
axempl i f 1 cat ! on of learning problems contrfbuted to a more meaningful 
Interpretation of the Inventory. 

Discussion of spfsciflc Instances of classroom learning problems 
indicated that such problems may occur as the function of several 
factors. The observed high occurrence of non^-academl c, disruptive, 
or off-task behaviors and the corresponding low^f requency of academic 
or on»task behaviors were considered In terms of classroom conditions 
which encourage or set the occasion for Improper responses, academic 
programs which do not provide posftlve learning responses, and in- 
effective or inconsistent use of reinforcement* 

_ m 

/Xmong the classrijom conditions which may be casual factors in 
the occurrence of students* off-task behavior is the prevailing 
organization of the classroom Into imal 1-group instruct lonal situatfons* 
This organization necassltates reoccurrlng major changes, in terms of 
both physical movement and psychological transitfons, in learning 
activities. That chlldran In such situations are often disruptive and 
do not follow directions or respond to the task indicates a need for 
tencher-trainrng In techniques of group management. Including those 
related to giving effective directions and promoting group involvement. 
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to faci 11 trite on-task learning behavior. 

In the development of EDUCOURSE ONE, teaching ski lis selected 
for inclusion were those aimed at elimfnatlng these problems by 
pronioting on-task student bahavtors, as wall as raducing off^task 
behaviors. The context of occurrence of learning problems specific 
to eKceptional children in the five-county area indicated that the 
areas of instructional skills most dl rectly related to these problems 

ware those of group managemant, task structurtng, and behavior 

modification, 

TEACHING SKILLS INVENTORY 

Wfth the identification of group managements task structuring, 
and bahavlor modification ds areas of content emphasis for EDUCOURSE 
ONEj ft was important to assess teacher competencies fn techniques 
related to these categories. 

A second Instrument, a self-report Inventory of teaching skills, 
was administered to taachari in the five-county area. In this 
Teaching Skills Inventory, the items of which correlated with the Learning 
Problems Inventory, teachers were asked to assess their own competencies 
in terms of instructional skills relevant to the alleviation of specfffc 
learning problems. 

The 24 teachers who responded to this Inventory assigned their 
lowest competencies to the following skfllsf 
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Competancy Item 
Ranking^^ _No^ Statemant of Teaching Skill 

' 5 Abilrty to get children to persevera on tasks, 

2 9 Ability to ignofe behavior irrelevant to learning* 

3 6 Ability to get children to follow diractions* 
^ 4 AbJIfty to create an fnterest for learning, 

5 (a) 11 Ability to individualize instruetlon. 

(b) 13 Ability to iustain interest In a learning activity. 

6 '5 Ability to communicate to children what is expected 

of them in terms of appropriate responses to 
1 earni ng tasks* 

7 (a) 2 Abflity to get children to pay attention to teacher, 
(b) 3 Ability to initiate a learning task. 

^^umber I indicates skill to which lowest connpetency was assigned. 

As a result of experiences in their own classrooms, exceptional 
child educators in the five-county area perceived major learning problems 
of their children as a tendency for disruption in group settings* limited 
task response. Inability to retain and use instruction, and inability to 
follow directions. The teachers' rank-ordered perceptions of thair 
lowest conipetencies In teaching skills included such abilities as getting 
children to persevere on tasks, ignoring behavior irralevant to learning/ 
getting children to follow directions, and helping them to become mora 
enthusiastic about learning. 

On the basis of information obtained from both inventories relevant 
to specffic learning problems of exceptional children, and perceived 
existing teacher compatencies In alleviating these problems, the content 
emphases of EDUCOURSE ONE were identified and specific instructional 
skills for inclusion fn the program were selected. 
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PACKAGING EDUCOURSE ONE 

During the 1970-71 school year the first version of EDUCOURSE 
ONE was completed. The ''package'* cQntainad a teacher handbook with 
an introduction, 5 chapters or f nitructional lessoni* and a serFes 
of 5 videotaped Instructional/model lesions* The handbook presented, 
the theoretical bases of the course* provided explanations and 
suggestions regarding each teacher behavior presented In the course, 
contained lesson plan aids for microteach and reteach lessons, and 
contained evaluation forms to measure teacher acquisition of skills 
and improvements in student attending behavior. The videotaped 
model lessons contained segments in which a model teacher was shown 
conducting a lesson in which each technique was demonstrated savaral 
times* While viewing the model lessons the teacher's attention was 
focused on major points by cues and narrator comments as these points 
were illustrated by the model teacher* 

PR ELIMINARY FIELD TEST 

The preUminary field test was begun In September. 1971 with 3 TMR ' 
teachers at Ft* Ogden School in DeSoto County^ 3 regular classr^m 
teachers at V/est Elementary School in OeSoto County- and I EMR teacher 
from Lee County * I fro^ Pinellas County, and 2 from the project area* 

Videotaped Model Lessons f Field test teachers Indicated to the 
staff that they were experiencing some difficulty in properly identifying 
the e)cample$ of skills shown in the vidoetaped model lessons. To check 
this further a group of ?n special education teachers In the project area 




who ware not Involved in the preliminary field test were asked to 
idantify the skills shown In the model lassons fn the first 2 
instructional sequences. 

The following tables Indicate the responses of those 20 teachers 
to the videotapes in terms of '^recognizing interfering behaviors,*' 
'identifying reinrorclng outcomes,'' and "encfting attending behavior." 
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RECOGNIZING INTERFERING BEHAVIORS 



r— 1 NUHBER OF EXAMPI P 


BEHAVIORS 


1 


2 


3 


k 


5 


6 


7 


8 


9 


10 


GROSS MOTOR 










*• 
18 






1 




NOISE MAKING 




c 






19 








19 


. 1 


VERBALIZATION 


20 


u 












19 






ORIENTING 




c 




20 




2 


1 






19 


AGGRESSION 




Si" 

U 


20 




1 




19 


I 







indicates correct nxample for each category 
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Handbook Haterials : FlalH-test participants were also questioned 
about the quality of the Handbook, 



ORIGINAL HANDBOOK EVALUATION 



Pre lim 1 na ry F 1 


eld 


Test 


(n- 


10) 












Handbook 


Seq 
Yes 


.#1 
to 


Seq 
Yes 


.#2 
No 


1 Seq. #3 
Yes No 


Seq, 
Yes 


No 


Seq, #5 
Yes No 


Each skill was clearly defined 


10 


0 


10 


0 


10 


0 


9 


1 


10 0 


Objectives v/ere clearly stated 


9 


1 


10 


d 


9 


1 


10 


0 


9 1 


Organization and sequence of 
sknis ware realistic and 
appropr F ate 


9 


1 


8 


2 


10 


0 


7 


3 


9 1 


Instruetioni for microteach 
lessons were clear and 
easl 1y fol lowed 


7 


3 


3 


7 


8 


2 


5 


5 


7 3 


Recording forms were clear 


9. 


1 


10 


0 


10 


0 


10 


0 


10 0 


Recording forms were appro* 
priate and easy to mark 


9 


1 


10 


0 


9 


1 


10 


0 


9 1 



As a result of these data^ along with many written comments and verbal 
suggestions, instructions for the microteach lessons were revised and the 
iequence and number of skills eventually were reorganized. The principal 
crftlcisms of the H_a_ndbook emerqing from the preliminary f lei detest were 
that It was too long and detailed and in several instances the content 
was overlapping. Consequently, the skills contained in the original 
Sequences h and S were combined, and the Handbook rewritten to include 
an introduction and only four instructional sequencei. 
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The 3 chackliits indicated considerable dffficu?ty on the part 
of the 20 EMR teachers In identifying the appropriate skills shown 
in the model lessons, particularly in relation to "elicfting attending 
behaviors J' 

Reports submftted by the 10 field-test participants evaluating the 
original videotapes qave support to the need for revision of the 
materials. 



ORIGINAL VIDEOT^^E EVALUATION 
Pranmlnary field test (nslO) 



Videotape Lessons 


Seq. 


^1 

NO 


Seq 
YES 


#2 
NO 


Seq 
YES 


.#3 
NO 


YES NO 


Saq. 
YES 


#5 
HO 


Examples are clear and 
easi ly identf fled 


7 


3 


8 


2 


6 


k 


9 


1 


9 


1 


Orqanizatiori and models 
shown agree with hand- 
book discussion " 


6 




7 


3 


9 


1 


8 


2 


10 


0 


Model lesson was helpful 
in planning and con- 
ducting microtaach session 


7 


3 


10 


0 


9 


1 


9 


1 


9 


1 



Much of the material in the first model lesson vldpotapes had been 
dubbed twice from original tapes, and the technical quality was poor as a 
result. Because of this and the difficulties experienced by both the 
field-test participants and the project area EMR teachers, a decision was 
made to redo the videotapes while the preliminary field test was still In 
ppoqress so as to make the examples of ski Us more expiiclt and improve 
the general auallty of the product, ■ ■ 
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IDENTIFYING ReiNFORCING OUTCOMES 





NUMBER 


W EXAMPLE 




OUTCOMES 


1 


2 


3 


k 


5 


TEACHER-ATTENTION 




20 


* 
13 






PEER-ATTENTION 


20 






3 


20 


OTHER 






7 


17 





^'indicates correct example for each category 
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ELICITING ATTENDING BEHAVIOR 



NUMBER OF EXAMPLE 



BEHAVIORS 


; I 


2 


3 


k 


5 


6 


7 


8 


9 


10 


DISCUSSING 




I 


* 
1 1 




15 


1 


15 




5 


* 
9 


ELICITING 

EXAMPLES 


6 


*■ 
19 


9 


1 


k 


18 


k 


1 


* 
14 


10 


ESTABLISHING 
RULES 








19 


1 


1 


1 


* 
19 


1 


1 



^'^indlcates correct example for each category 
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MAIN FIELD TEST 

Sixteen EMR teachers ware Involvad In the main field test 8 from 
the Nina Harris Exceptional Child Education Center in St.. Petersburg, 
k from the Volusja Avenue Elementary School in Daytona Beachp and k from 
the Euclid Avenue Elementary School in Deland, These pirticipants were 
raquestad to evaluate the videotaped r nitructiona] lessons and the Handbook 

Videotaped Modal Lesions - Their evaluation of the model lessons 
indicated quits dafU'tely that the revision of the original videotapes had 
been' both necessary and ben.-ficial. In only 7 instances out of 192 
possibi 1 it f as were the rasponsei of the participants negative* 



REVISED VIDEOTAPE EVALUATION 
Main Field Test (n^l6) 



Videotape Lessons 

Examples are clear and 
easi ly ident i fled 


Seq. 
Yes 


#1 
No 


Seq . 
Yes 


m 

No 


Seq. #3 
Yes No 


Saq, 
Yes 


m 

No 


16 


0 


12 


k 


16 0 


16 


0 


Organization and models 
shown agree with Hand- 
book discussion 


16 


0 


16 


0 


16 0 


16 


0 


Model lesson was helpful 
in planning and conduct- 
ing mlcroteach session 


15 


I 

1 


15 


1 1 

1 


16 0 


15 


1 



While these data indicated that the new examples were clear and the 
ski Ms were demonstrated explicitly, the field-test teachers noted that the 
model teacher and the students were too formal and the classroom scenes 
appeared to be staged. As a result of these cri ticisms, the scripts were 
rewritten and all of the videotaped instructional sequences were revised 
subsequent to the main field test. 
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Handbook Hater la Is r Field-test teacheri Indicatad almost unanimously 
that the various Handbook lesions and forms as rawrltten were clearly itated 
and defined and alio appropriate as to content. 



REVISED HANOBOOK EVALUATION 
Main Field Test (n-16) 



Handbook 


Seq, 
Yes 


#1 
No 




Seq. 
Yes 


#2 
No 


Seq . 
Yes 


#3 
No 


Seq. # k 
Ye^ No 


Each skill was clearly 
defined 


16 


0 




16 


0 


16 


0 


16 0 


Objectives were clearly 
s tatad 


16 


0 




16 


0 


16 


0 


16 0 


Organization and sequence 
of skills were realistic 
and appropriate 


16 


0 




16 


0 


15 


1 


15 1 


Instructions for micro- 
teach lessons were clear 
and easily followed 


15 


1 




16 


0 


16 


0 


16 0 


Recording forms were 
c 1 ea r 


!6 


0 




16 


0 


16 


0 


16 0 


Recording forms were 
appropriate and easy 
to mark 


16 


0 




16 


0 


15 


1 


15 1 


General Evaluation: 


Field-test 


teachers 


were 


asked 


at th 


e end of the 


course to compare EDUCOURSE 1 wi 


th other 


i nserv i ce 


training axperiencei 


to which they had been exposed. 


Five 


of 


the part i c i pants 


bel leved 1 1^ was 


'*much better thanj-- 6 reported f 


t was 


"better 


than, 


" and 5 


indicated It was 


"on a par with''. other inservice 


programs 


they 


had eKparienced, 


1 1 was 


Interesting to note that a] 


i of 


the k 


teachers 


from 


one of 


the 


part Icipatf ng 



schools felt it was *^on 3 por with'' other programs. They stated that they 



were *-^lrnady using the reinforcement and reward methodi involved In behavfor 
modlf icat ion* 
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3. EVALUATION OF PROJECT 

The major objective of the project was to (1) reduce the occurrence 
of student behaviori which Interfere with attention, and (2) elicit and 
maintain student attending behavior. Since the latter (2) is primarily a 
reciprocal of the former (I), the evaluation of student behavioral outcomes 
was based on a meaiurement of interfering student behaviors which occurred 
in a typical classroom learning situation before and after EDUCOURSE I was 
completed by the 16 teachers who participatad in the main field-test. 

In the spring of 1972 participating teachers were given the following 
I ns t ruct I ons : 

Plan an instructional lesson. The acad«nlc content of the 
activity is not significant; however, it ihould provide an 
opportunity for all students to actively participate. The 
activity should last for fifteen minutes. Your directions 
to the students should be recorded at the beginning of the 
tape. 

When you have completed the tape, record the information i n- 
dica ted below: 

DATE OF RECORDING 

NATURE OF INSTRUCTIONAL TAS K 

NUMBER OF STUDENTS INVOLVE D 

TYPE OF PARTICIPATION REqUIRED 

Technical arrangements ware made for 15 minute videotapes to be completed 
for learning activities in each of the 16 classrooms. The week after pre-course 
videotaping was compleled, the project was begun, it lasted for a 3-week period. 
A rotating substitute teacher was employed to allow the field--test teachers 
time to take the course. During the week after compleclon of the course, 
post-course videotapes were made In the same cl ass rooms and under the same 
conditions as the pre-course t^pes. 



The tapes were analyzed by 3 raters who were instructed to make a 
tally of each occurrence of an Interfering behavior. Raters were pre* 
iented with the following classification for interfering behaviors 
(taken from page 26 of the Handbook) . 



INTERFERING BEHAVIORS 



Class I fi cat ions 



] , Gross Motor 



2 * No I se Mak i ng 



3 , Verba 1 1 zat i on 



4, 0 r 1 ent t ng 



5. Aggress Ion 



Spec i f I c Behav iors 

getting out of seat 

wa 1 ki ng around 

hoppi ng^ skipping, Jumping 

moving desk to neighbor 

rocking desk 

f 1 a i 1 j ng arms 

clapping hands 
tapp i ng f ec-^t 

tapping pencil or other object 
rattling or tearing paper 

whis 1 1 Ing or s i ngi ng 

1 augh f ng 

crying 

calling out to teacher 
making extraneous comments 
talking with other children 

turning head or body toward 

another person 
looking at another child 
looking at objects 
showing objects to another child 

pushing or shoving 
hi tting or kicking 
poking with objects 
grabbing objects or work 
knocking books off desk' 
throwing objects 
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The field-test teachers had been selected originally on the basis of the 
availability of at leas; k special education (EMR) teachers in one school in a 
Florida district that was willing to cooperate with the testing procedures. 
Pinellas County furnished one school with 8 teachers, and Volusia County 
two schools with k teachers each. 

The 3 Videotape "raters" included the field-test classroom teacher 
(each rating his own tape) and 2 graduate students In special education 
at the University of MUmi. There was considerable difference among the 
raters In terms of the gross number of interfering behaviors tallied, but 
the relative proportion of tallies between the pre and post tapes was 
fairly consistent. Using Ebel's interclass correlation coefficient 
formula for interrater reliability rkk = Vp - Ve the following' 
reliability scores were obtained for different sampUs of the ratings for 



interfering behaviors, 



INTERRATER RELIABILITY 
(n=3) 



Samp I e i- 

Groii Motor (pre 4- post) .9) 

Gross Motor (pre) ^78 

Qrosi Motor (pre-poit) ,82 

Aggression (pre) ^82 

Verbalization (pre-post) .55 



The following 3 tablas indicatt the differences found by the 3 raters 
between the pre-course and post-course tapes. The differences were 
slgniflcent «t the .01 or .001 level in all but two cases and illustrate 
the high success of the program in terms of achieving its major objective. 

Put another way. the reduction in tha number of student interfering 
behaviors was 63 per cent for the gross motor category. 5k per cent for 
noise making, 59 per cent for verba 1 i „t Ion . Ug per cent for orienting, and 
^1 per cent for aggression. 

There were certain variables present in the tapes and in the rating 
procedures which should be mentioned. 

I. The teacher-rater only viewed the tapes once In making tallies 

other Craters ' ThH''' f-^derably less behaviors'than the 
other 2 raters. The d graduate students, in addition to viewing 
the tapes several times, also had the advantage of greater train- 
ing and background in this type of procedure. S^^^^er tra.n- 

2. In some cases the teacher was out of camera range and it was 
not'ltteJd'g"" ^'"'^^ -^-"^^"^ ^° ^im or was 

3. Pre and post tapes were taken from different angles fe a front 
v.ew or rear view) which may have accounted fo^s^a differences . 

• f^^ .'hM J"'"!^?,""'^ consisted of independent study activities 

for children while post tape lessons were more often teacher- 
directed This factor may have contributed to the extent of the 
differences between the 2 sessions. 

5. ^ P°st-course tape made several weeks following the program might 
have yielded considerably less differences than one taken a welk 
later. The spring closing of schools prevanted this sort of 
measurement being taken. 
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DIFFERENCES IN STUDENT INTERFERING 
BEHAVIORS BEFORE AND AFTER EDUCOURSE I 
First Rater (n-l6 classes) 



erJc 



Mean Scores 
Interfering pre- Poit- 

Behavior Course Course 



Gross Motor 697 267 i+30 5. 00* 

Noise Making 378 I76 202 3.79** 

Verbal ization 807 305 502 k.06-Me 

Orienting gitS 362 28I 3.23** 

Aggression 39 29 10 Klt3*** 



1 A itatisticai test to determine whether two mean scores are 
significantly different, 

*p<.00l -V* p<.0l ***p<.20 

(p indicates the probability that a difference in mean scorei 
occurred by chance. For example, p<.0OI indicates that there Is 
only one chance in a thousand that the difference between pre- 
and post course measures would have occurred by chance). 
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PIFFERENCES IN STUDENT INTERFERING 
BEHAVIORS BEFORE AND AFTER EDUCOURSE I 
Second Rater (n=l6 classes) 



1 hterferi ng 
Behevl or 


Mean Scores 
Pre- Post- 
Course Course 


D 


t 


Grosi Motor 


280 


96 


184 




Noisa Making 


173 


77 


96 




Verba 1 i zat i on 


253 


1 16 


137 




Orient ing 


257 


1 19 


138 


3 . 60^^ 


Aggress Ion 


58 


28 


30 




* p<.001 * 


* p<.01 *M( p<.02 








DIFFERENCES IN STUDENT INTERFERING 
BEHAVIORS BEFORE AND AFTER EDUCOURSE 
Third Rater (n-Ifi classes) 


1 


1 nterf at* i ng 
Sehay lor 


Mean Scores 
Pre- Post- 
Course Course 


D 


t 


Gross Motor 


654 


238 


416 


6.67^ 


Nol se Maki ng 


346 


; '2 


184 


5,73^ 


Verba 1 i zat ion 


562 


234 


328 


7.02^v 


Orient i ng 


502 


233 


269 




Aggress ion 


48 


16 


32 





* p<.001 
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